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Introduction. - The construction of a realization for the minimal 
unitary representation of a simple Lie group by using geometric quan- 
tization has been the topic of many papers during the last thirty years: 
[Rawnsley-Sternberg,1982], [Torasso,1983], and more recently [Kobayashi- 
0rsted,2OO3]. In a series of papers R. Brylinski and B. Kostant have intro- 
duced and studied a geometric quantization of minimal nilpotent orbits 
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for simple real Lie groups which are not of Hermitian type: [Brylinski- 
Kostant, 1994,1995, 1997], [Brylinski, 1997,1998] . They have constructed 
the associated irreducible unitary representation on a Hilbert space of 
half forms on the minimal nilpotent orbit. This can be considered as a 
Fock model for the minimal representation. In this paper we revisit this 
construction with another point of view. We start from a pair (V, Q) 
where V is a complex vector space and Q is a homogeneous polynomial 
on V of degree 4. The structure group Str(V, Q), for which Q is a semi- 
invariant, is assumed to have a symmetric open orbit. The conformal 
group Conf( V, Q) consists of rational transformations of V whose differ- 
ential belongs to Str(V, Q). The main geometric object is the orbit S of 
Q under K, a covering of Conf(V, Q), on a space W of polynomials on V. 
Then, by a generalized Kantor-Koecher-Tits construction, starting from 
the Lie algebra t of K, we obtain a simple Lie algebra g such that the pair 
(g,l) is non Hermitian. As a vector space q = t © p, with p = W. The 
main point is to define a bracket 

p©p^£, (X,Y)^[X,Y], 

such that g becomes a Lie algebra. The Lie algebra g is 5-graded: 

g = g_ 2 © 0_i © 0o © 01 © 02- 

In the fourth part one defines a representation p of on the space 0(S)fl n of 
polynomial functions on S. In a first step one defines a representation of an 
sl2-triple (E, F, H). It turns out that this is only possible under a condition 
T. In such a case one obtains an irreducible unitary representation of the 
connected and simply connected group whose Lie algebra is a real 
form of 0. The representation is spherical. It is realized on a Hilbert 
space of holomorphic functions on S. There is an explicit formula for the 
reproducing kernel of T-L involving a hypergeo metric function 1F2. Further 
the space H is a weighted Bergman space with a weight taking in general 
both positive and negative values. 

If Q = R 2 or Q = R 4 where R is a semi-invariant, then by considering 
a covering of order 2 or 4 of the orbit S, one can obtain one or 3 other 
unitary representations of Gr. They are not spherical. If the condition T 
is not satisfied, by a modified construction, one still obtains an irreducible 
representation of Gr which is not spherical. This last point is the subject 
of a paper in preparation by the first author. 

The construction of a Schrodinger model for the minimal representation 
of the group 0(p, q) is the subject of a recent book by T. Kobayashi and 
G. Mano [2008]. We should not wonder that there is a link between 
both models: the Fock and the Schrodinger models, and that there is an 
analogue of the Bargmann transform in this setting. 
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1. The conformal group and the representation k. — Let V be a 

finite dimensional complex vector space and Q a homogeneous polynomial 
on V. Define 



L = Str(V, Q) = {ge GL{V) | 3 7 = -y(g),Q(g ■ x) = >y(g)Q(x)}. 



Assume that there exists e G V such that 
(1) The symmetric bilinear form 



D x D y logQ(e), 



is non-degenerate. 

(2) The orbit O = L ■ e is open. 

(3) The orbit O = L ■ e is symmetric, i.e. the pair (L, Lo), with 
Lq = {g G L | g ■ e = e}, is symmetric, which means that there is an 
involutive automorphism v of L such that Lo is open in {g e L | i^(^) = (7}. 

We will equip the vector space F with a Jordan algebra structure. 
The Lie algebra I = Lie(L) of L = Str(V, Q) decomposes into the 
+1 and —1 eigenspaces of the differential of v : I = lo + q, where 
lo = {X G I I X.e = e} = Lie(L ). Since the orbit Q is open, the 
map 

q ->■ V, X ^ X.e, 

is a linear isomorphism. If X ■ e = x (X G q, x G V) one writes X = T x . 
The product on V is defined by 

xy = T x ■ y = T x o T y ■ e. 

Theorem 1.1. - This product makes V into a semi-simple complex 
Jordan algebra: 

(Jl) For x,y G V,xy = yx. 

(J2) For x, y G V, x 2 (xy) = x(x 2 y). 

(J3) The symmetric bilinear form (., .) is associative: 



since [q, q] C lo- 

(b) Let r be the differential of 7 at the identity element of L: for lei, 



(xy,z) = (x,yz). 



Proof, (a) This product is commutative. In fact 



xy-yx = [T x ,T y ] ■ e = 0, 



t(X) 



d 

dt t=o 



7(exptX). 
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Lemma 1.2. 

(i) (D x \ogQ)(e) = r(T x ), 

(ii) (D x D y logQ)(e) = -T(T xy ), 

(iii) (D x D y D z \ogQ)(e) = \r{T {xy)z ). 

The proof amounts to differentiating at e the relation 

logQ(expT x • e) = r(T x ) + logQ(e), 

up to third order. (See Exercise 5 in [Satake, 1980], p. 38.) Hence, by 
(ii), (x,y) = r(T xy ), and, by (iii), the symmetric bilinear form (., .) is 
associative. 

(c) Define the associator of three elements x, y, z in V by 

[x, y, z] = x(zy) - (xz)y = [L(x), L(y)]z. 

Identity (J2) can be written: [x 2 ,y,x] = for all x,y G V. It can be 
shown by following the proof of Theorem 8.5 in [Satake, 1980], p. 34, which 
is also the proof of Theorem III. 3.1 in [Faraut-Koranyi,1994], p. 50. [] 

The Jordan algebra V is a direct sum of simple ideals: 

i=l 

and 

s 

Q(x) = Y[Ai(xi) ki (x = ( Xl ,...,x s )), 
i=i 

where Aj is the determinant polynomial of the simple Jordan algebra Vi 
and the hi are positive integers. The degree of Q is equal to Xli=i ki r ii 
where is the rank of Vi. 

The conformal group Conf(V, Q) is the group of rational transforma- 
tions g of V generated by: the translations z h-» z + a (a G V), the 
dilations z *-> £• z (! 6 L), and the inversion j : z *-> —z~ x . A transforma- 
tion g G Conf(V, Q) is conformal in the sense that the differential Dg(z) 
belongs to L G Str(V, Q) at any point z where g is defined. 

Let W be the space of polynomials on V generated by the translated 
Q(z — a) of Q. We will define a representation k on W of Conf (V, Q) or 
of a covering of order two of it. 



4 



Case 1 

In case there exists a character x of Str(V, Q) such that x 2 = 7, then 
let X = Conf(V, Q). Define the cocycle 

»(g,z) = X ((Dg(z)- 1 ) (g G K, zeV), 

and the representation k of K on W, 

(/c(^)p)(z) = ^(g' 1 , z)p(g~ 1 ■ z). 

The function K,(g)p belongs actually to W. In fact the cocycle fi(g, z) is a 
polynomial in z of degree < deg Q and 

(«(to)p)(^) =p(z - a) (aeV), 

W) P ){z) = xWpiT 1 • z) (teL), 

(K(j)p)(z)=Q(z)p(-z- 1 ). 

Case 2 

Otherwise the group K is defined as the set of pairs (g, y) with 
g G Conf (V, Q), and \x is a rational function on V such that 

y{zf = l{Dg{z))-\ 

We consider on K the product (gi, [ii)(g2, ^2) = (<7i<72> ^3) with ^3(2;) = 
A*i(#2 • z)/j,2(z). For g = (g,/i) e K, define 2) := ^(z). Then 2) is 
a cocycle: 

M#l#2, ^) = #2 • ^)M#2, 

where (7 • z = g ■ z by definition. 

Proposition 1.3. — (i) The map 

K^Conf(V,Q), g={g,n)^g 

is a surjective group morphism. 

(ii) For g G K , fj,(g, z) is a polynomial in z of degree < deg (J. 

Proof. It is clearly a group morphism. We will show that the image 
contains a set of generators of Conf(V, Q). If g is a translation, then 
(<7, 1) and (g, —1) are elements in K. If g = i G L, then Dg(z) = i, and 
(£, a), (£, —a), with a 2 = 7(£) _1 , are elements in if. If g-z = j(z) := — 
then Dg{z)~ 1 = P(z), where P(z) denotes the quadratic representation 
of the Jordan algebra V: P(z) = 2T 2 - T 2 2, and l{P{z)) = Q(zf . Then 
(j, Q(z)), (j, Q(—z)) are elements in K. | j 
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Let -P max denote the preimage in K of the maximal parabolic subgroup 
Ltx N C Conf (V, Q), where N is the subgroup of ranslations. For g e -P ma x 5 
/u((7, z) does not depend on z, and x(fiO = A t (fi ,_1 5 2; ) is a character of -P max - 
For # = (£ G L), X {9? = 7^)- 

Observe that the inverse in K of a = (j,Q(z)) is a 1 = (j, Q(— z)). If 
K is connected, then K is a covering of order 2 of Conf(V, Q). If not, the 
identity component Kq of if is homeomorphic to Conf(V, Q). 

The representation k of if on W is then given by 
(K(g)p) (z) = nig' 1 , z)p(g~ 1 ■ z). 

In particular 

(K(g)p)(z) = x(g)p(9~ 1 ■ z) (g G P max ), 
( K (a)p)(z) = Q(-z)p(-z- 1 ). 

Hence po = 1 is a highest weight vector with respect and Q = K(a)po is a 
lowest weight vector. 

Example 1 

If V = C, Q(z) = z n , then Str(V, Q) = C*, 7^) = £ n , and 
Conf (V, Q) ~ PSL(2, C) is the group of fractional linear transformations 

z^^.z=_,with^=^ d jG5L(2,C). 

Furthermore 

(^7^2 » 7(^)" 1 ) = (^ + rf) 2n , /*(</,*) = (<* + <*)"• 

Hence, if n is even, then K = PSL(2,C), and, if n is odd, then 
K = SL(2,C). 

The space W is the space of polynomials of degree < n in one variable. 
The representation k of K on W is given by 

w^)w=(-^)>(^),if^=(: *). 

Example 2 

If V = M (ra, C), = det z, then Str(V, Q) = GL(n, C) x GL(n, C), 
acting on F by 
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Then 7(f) = det^i det£ 2 , and 7 is not the square of a character of 
Str(V,Q). Furthermore Conf (V, Q) = PSL(2n,C) is the group of the 
rational transformations 

z ^ g-z = (az + b)(cz + d)' 1 , with g = ^ G SL(2ra,C), 

decomposed in n x n-blocs. To determine the differential of such a 
transformation, let us write (assuming c to be invertible) 

g ■ z = (az + c)(cz + cf) _1 = ac _1 — (ac _1 <i — b)(cz + d) -1 , 

and we get 

Dg(z)w = (ac~ 1 d — b)(cz + d)~ 1 cw(cz + d)~ x . 

Notice that G Str(V,Q): 

Dg(z)w = ixwi^ 1 , with £1 = (ac _1 d - 6)(cz + d) _1 c, £ 2 = (cz + d). 

Since det (ac~ 1 d — b) det c = det g = 1, 

7(L>#(z)- 1 ) = det(c^ + d) 2 . 

It follows that .ftT = SL(2n, C), and /i(g, 2) = det(c£ + d). 

The space W is a space of polynomials of an n x n matrix variable, with 
degree < n. The representation k of K on W is given by 

= det(cz + d)p((az + b)(cz + d)" 1 ), if g~ x = 

2. The orbit S, and the irreducible K-invariant Hilbert 
subspaces of 0(E). - Let S be the X-orbit of Q in W: 

S = {n(g)Q \geK}. 

Then S is a conical variety. In fact, if £ = n(g)Q, then, for A G C*, 
M = ^fi 1 h t )Q, where h t ■ z = e~ t z (t G C) with A = e 2t . 
A polynomial £ G W can be written 

£(i>) = wQ(v) + terms of degree < 4 (to G C), 

and w = w(£) is a linear form on W which is invariant under the parabolic 
subgroup -P max - The set S = {£ G S | w(£) 7^ 0} is open and dense in S. 
A polynomial £ G So can be written 

i(v) = wQ(v-z) (w eC*,z eV). 
7 




Hence we get a coordinate system (w, z) G C* x V for S . 

Proposition 2.1. - In this system, the action of K is given by 

n(g) : (w, z) H> (n(g, z)w, g-z). 

Observe that the orbit S can be seen as a line bundle over the conformal 
compactification of V. 

Proof. Recall that, for £ G H, 

{K(g)Z)(v) = n(g- 1 ,v)Z(g- 1 -v), 

and, if £(v) = wQ(v — z), then 

= Kg' 1 , v)wQ(g~ 1 ■ v - z) = Kg' 1 , v)wQ(g~ 1 ■ v - g~ x g ■ z). 

By Lemma 6.6 in [Faraut-Gindikin,1996], 

Kg, z)n(g, z')Q(g ■ z - g' ■ z') = Q(z - z'). 

Therefore 

(K(g)0( v ) = Kg' 1 , 9 ■ z)~ 1 wQ(v - g.z) = Kg, z)wQ(v -g-z), 

by the cocycle property. ; J 

The group K acts on the space 0(E) of holomorphic functions on S by: 

(Kg)f)(0 = f«g)-^)- 

If £ G Sq, i.e. £(v) = wQ(v—z), and / G 0(E), we will write /(£) = 4>(w, z) 
for the restriction of / to S . In the coordinates (w, z), the representation 
tv is given by 

(ic(g)<j>)(w,z) = (p(p(g~ 1 ,z)w,g- 1 ■ z). 

Let O m (E) denote the space of holomorphic functions / on S, homoge- 
neous of degree m G Z: 

f(X) = X n f(t) (AgC*). 

The space m (E) is invariant under the representation 7r. If / G (9 m (£), 
then its restriction <p to So can be written (j)(w,z) = w rn tf)(z), where ip is 
a holomorphic function on V. We will write O m (V) for the space of the 
functions ip corresponding to the functions / G C m (S), and denote by Tv m 
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the representation of K on O m (V) corresponding to the restriction Tv m of 
7T to O m (E). The representation 7r TO is given by 

(n m (g)i;)(z) = ^g- 1 ^)^- 1 ■ z). 

Observe that (n m (a)l)(z) = Q(-z) m . 

Theorem 2.2. - (i) O m (E) = {0} for m < 0. 

(ii) X7ie space m (H) is /imte dimensional, and the representation Tv m 
is irreducible. 

(iii) TTie functions tp in O m (V) are polynomials. 

Proof, (i) Assume m (E) ^ {0}. Let / G m (E), / ^ 0, and 
4>(w,z) = ip(z)w m its restriction to S . Then ip is holomorphic on V, 
and 

(7f m ( ( 7)v)(^) = Q(-^rv(-^ 1 ), 

is holomorphic as well. We may assume V( e ) 7^ 0. The function 
h(() = ip((e) (C G C) is holomorphic on C, 

oo 

MO = 

fc=0 

together with the function 

1 1 00 1 

Q(Ce) m V(-Te) = C m7V M— ) = C mN £>*(--)* ( N = de ^)- 
^ ^ fc=0 ^ 

It follows that m > 0, and that ak = for > miV. 

(ii) The subspace 

{/ G C m (S) | Va G 7r(r )/ = /} 

reduces to the functions Cw m , hence is one dimensional. By the theorem 
of the highest weight [Goodman, 2008], it follows that O m (E) is finite 
dimensional and irreducible. 

(iii) Furthermore it follows that the functions in (9 m (S) are of the form 
w m ifj(z), where ip is a polynomial on V of degree < m ■ deg Q. [\ 

We fix a Euclidean real form Vr of the complex Jordan algebra V, 
denote by z 4 z the conjugation of V with respect to Vr, and then 
consider the involution g i-> g of Conf (V, Q) given by: g ■ z = g ■ z. For 
(#, fi) E K define 

(#,A0 = where = n{z). 
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The involution a denned by a(g) = a o g o a 1 is a Cartan involution 
of K (see Proposition 1.1. in [Pevzner,2002]), and 

K R := {g E K \ a(g) = g} 

is a compact real form of K. 



Example 1. 

If V = C, Q(z) = z n . Then Vr = M, and z i— >■ z is the usual conjugation. 
We saw that K = PSL{2, C) if n is even, and SL(2, C) if n is odd. For 
geSL(2,C), 

a b 

s c d 

we get 
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a{g) 



o l 
-l o 



a b 
c d 



-1 

1 



d 



Hence Kr = PSU(2) if n is even, and Kr = SU{2) if n is odd. 
Example 2. 

If V = M(n,C), Q(^) = detz, then Vr = Herm(n 7 C) and the 
conjugation is z>-> z*. We saw that if = SL(2n, C). For 5r e SL(2n, C), 



a 6 
c <i 



we get 



I 
-I 



d* 



-J 
7 



d* -c* 
-b* a* 



Hence K R = SU(2n). 



We will define on (9 m (S) a i^R-invariant inner product. Define the 
subgroup K of K as i^o = L in Case 1, and the preimage of L 
in Case 2, relatively to the covering map K — > Conf(V, Q), and also 
(K"o)r = i^o H TCr. The coset space M = K-r/ (Ko)m, is a compact 
Hermitian space and is the conformal compactification of V. There is 
on M a K"R-invariant probability measure, for which M \ V has measure 
0. Its restriction mo to V is a probability measure with a density which 
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can be computed by using the decomposition of V into simple Jordan 
algebras. 

Let H(z, z') be the polynomial on V x V, holomorphic in z, anti- 
holomorphic in z' such that 

H(x,x) =Q(e + x 2 ) (xeVn). 

Put H(z) = H(z, z). If z is invertible, then H(z) = Q{z)Q{z~ l + z). 
Proposition 2.3. — For g e K R , 



H(g ■ z lt g ■ z 2 )fi(g,z 1 )n(g, z 2 ) = H(z lt z 2 ), 

and 

H(g-z)\f,(g,z)\ 2 = H(z). 

Proof. Recall that an element g G -£Tr satisfies aogoa~ l = g, or aog = goa. 
Recall also the cocycle property: for gi,g 2 £ K, 

Kgi92, z) = fi(gi, g 2 ■ z)fi(g 2 , z). 
Since fi(a, z) = Q(z), it follows that, for g e Km., 

fi(g,a ■ z)Q(z) =Q(g ■ z)fi(g,z). (1) 
By Lemma 6.6 in [Faraut-Gindikin,1996], for g G K, 

Q(g ■ zi - g ■ z 2 )/j,(g, z\)n(g, z 2 ) = Q(z x - z 2 ). (2) 

For g G K R , 

H(g -Z!,g- z 2 ) = Q(g ■ z 2 )Q(g ■ z\-og> z 2 ) 
= Q(g ■ z 2 )Q(g ■ z t - gaz 2 ), 

and, by (2), 

= Q(g ■ z 2 )/J,(g, zx)' 1 ^, a ■ z 2 )~ 1 Q(z 1 - a ■ z 2 ). 
Finally, by (1), 

= ^(g,z 1 )~ 1 ^(g,z 2 )~ 1 H(z 1 ,z 2 ). Q 
We define the norm of a function tp G O m (V) by 

= — / mz)\ 2 H{z)- m m {dz), 

Am JV 
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2 

rn 



with 



a m = [ H(z)- m m (dz). 
Jv 



Proposition 2.4. - (i) This norm is K R -invariant. Hence, O m (V) 
is a Hilbert subspace ofO{V). 

(ii) The reproducing kernel of O m (V) is given by 

iC m (z,z') = H(z,z') m - 
Proof, (i) From Proposition 2.3 it follows that, for g £ K R , 

\\Km(g- 1 W m = — I \Kg,z)\ 2m \^{g- 1 ■ z)\ 2 H(z)-™m (dz) 
= —[ mg-'-z^Hig-'-zr^moidz) 

Q>m JV 

1 f \^{z)\ 2 H{z)- m m {dz)^^- 



dm Jv 



(ii) There is a unique function ifj £ O m (V) such that, for ip £ O m (V), 

| Vo) = ^(0). 

The function ipQ is i^ - mvar i an t, therefore constant: ifjo( z ) = C- Taking 
-0 = ipo, one gets C 2 = C, hence C = 1. It means that, if K, m {z,z') 
denotes the reproducing kernel of O m {V), 

iC m {z^) = t m {^z') = l. 

Since JC m (z, z') and H(z,z') satisfy the following invariance properties: 
for g £ K R , 



fc m (g- z,g- z')n(g, z) m ij(g, z') = JC m (z, z), 



H(g -z,g- z')/i(g, z)^(g, z>) = H(z, z'), 

it follows that 

ft m (z,z') = H(z,z') m - D 

Since O m (E) is isomorphic to O m (V), the space C m (S) becomes an 
invariant Hilbert subspace of C(S), with reproducing kernel 

12 



where 

m o = H( z , z')wii7 (e = (w, z ),e = k, z')). 

Theorem 2.5. - The group K-r acts multiplicity free on 0(E). The 
irreducible K^-invariant subspaces o/C(S) are the spaces O m (E) (m EN). 
IfHc 0(E) is a K-R-invariant Hilbert subspace, the reproducing kernel of 
H can be written 



m=0 

^0O 



with c m > 0, such that the series X^m=o c m^(^, £,') m converges uniformly 
on compact subsets in S. 

This multiplicity free property means that acts multiplicity free on 
every .K^-invariant Hilbert space % C 0(2). 

Proof. The representation n of Km. on 0(E) commutes with the en- 
action by dilations and the spaces (9 m (£) are irreducible, and mutually 
inequivalent. It follows that K-r acts multiplicity free. \ ] 

In case of a weighted Bergman space there is an integral formula for 
the numbers c m . For a positive function p(^) on S, consider the subspace 
V, C 0(E) of functions <j> such that 

\<j>(w, z) \ 2 p(w, z)m(dw)mo(dz) < oo, 

CxV 

where m(dw) denotes the Lebesgue measure on C. 

Theorem 2.6. - Let F be a positive function on [0, oof, and define 

p(w,z) = F(H(z)\w\ 2 )H(z). 

(i) Then H is K^-invariant. 

(ii) // 

oo 



m=0 



then 



with 



oo 

Cm 



m=0 



1 f°° 

— = 7ra m / F(u)u m du. 

Cm JO 
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(iii) The reproducing kernel ofH is given by 

oo 

Proof, a) Observe first that the function defined on S by 

(w, z) i — Y \w\ 2 H(z), 

is i^R-invariant. In fact, for g e K, 

K{g) : (w, g) i— >■ (//(^, # • z) , 

and, by Propositiion 2.3, for (7 e -£Tr, 

\»(g,z)\ 2 H(g-z) = H(z). 

Furthermore the measure h(z)m(dw)mo(dz) is also invariant under K-r- 
In fact, under the transformation z = g ■ z' ,w = fi(g, z')w' (g G -£Tr), we 
get 

H (z)m(dw)mo(dz) — H(g ■ z')\/j,(g, z')\ 2 m(dw')mo(dz') 
= H(z')m(dw')m (dz'). 

b) Assume that p(w,z) = F(H(z)\w\ 2 )H(z). Then 
lk(<7)0|| 2 = / \(f>(fi(g-\z)w,g- 1 -z)\ 2 F(H(z)\w\ 2 )H(z)m(dw)m (dz). 

JCxV 

We put 

g~ x ■ z = z , /j(g~ 1 ,z)w = w' . 
By the invariance of the measure H(z)m(dw)mo(dz), we obtain 

lk(<7)0ll 2 = 

f \<P(w\ z')\ 2 F(H(g ■ z')\n{g-\ g ■ z')\- 2 \w'\ 2 )H(z')m(dw')m (dz'). 

JCxV 
Furthermore 

H(g ■ z'mg-\ g ■ z')\~ 2 = H(g ■ *')K<7, z')\ 2 = H(z% 
and, finally, ||7r(#)0|| = ||0||. 
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c) If (j)(w, z) = w m ip(z), then 

\\<P\\ 2 = [ \w\ 2rn \ifj(z)\ 2 F(H(z)\w\ 2 )H(z)m(dw)m (dz'). 

JCxV 

We put w' = y / H(z)w, then 

||0|| 2 = [ H(z)- m \w'\ 2m \ij(z)\ 2 F(\w'\ 2 )m(dw')mo(dz') 

JCxV 

= a m U\\ 2 m I F(\w'\ 2 )\w'\ 2 ™m(dw') 
Jc 

POO 

= a m U\\ 2 m 7r F(u)u m du. D 
Jo 

3. Decomposition into simple Jordan algebras. Let us 

decompose the semi-simple Jordan algebra V into simple ideals: 

v = @v,. 

Denote by rii and ri the dimension and the rank of the simple Jordan 
algebra Vi, and Aj the determinant polynomial. Then 

s 

Q(z) = l[A i (z i ) ki . 

i=l 

Let H{(z, z') be the polynomial on Vi x Vi, holomorphic in z, antiholomor- 
phic in z', such that 

Hi(z,z') = A^e. + x 2 ) {xe(Vi) m ), 

and put Hi(z) = Hi(z, z). The measure mo has a density with respect to 
the Lebesgue measure m on V: 

m (dz) = —H (z)m(dz), 

with 

s 

H (z) = l[H l (z l )- 2 ^ 7 

i=l 

C = f H (z)m(dz). 
Jv 

15 



The Lebesgue measure m will be chosen such that C = 1. 

Proposition 3.1. - (i) The polynomial Q satisfies the following 
Bernstein identity 

Q(^)Q(z) a = Bi^Qiz)"- 1 (zeC), 
where the Bernstein polynomial B is given by 

s 

B ( a ) = Wbi{kia)bi{kia - 1) . . .bifaa - h + 1), 

i=l 

and bi is the Bernstein polynomial relative to the determinant polynomial 
A*. 

(ii) Furthermore 

Q ilL) H{z)a = Bi^Q&HizY- 1 . 

Proof, (i) The Bernstein identity for Q follows from Proposition VII. 1.4 
in [Far aut-Koranyi, 1994]. 
(ii) For z invertible 

H(z) = Q{z)Q{z~ 1 +z), 

and then, by (i), 

Q^H(z) a = Q{z) a B(a)Q{z~ 1 + z)^ 1 

= Q(z)B(a)H(z) a - 1 . D 



Example 1 

If V = C, Q(z) = z n , then 

(^)V Q =B(a)z n ^- 1 \ 

with 

B(a) = na(na — 1) . . . (not — n + 1). 
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Example 2 

UV = M(n,C), Q{z) =detz, then 

det(— )(detz) a = B(a)(detz) a -\ 

with 

B(a) = a(a + 1) . . . (a + n — 1). 

Recall that we have introduced the numbers 

a m = / H{z)- m m {dz). 
Jv 

Proposition 3.2. 



'" n r (£) II r (mA .. + 2 M)' 

where F^. is i/ie Gindikin gamma function of the symmetric cone m 
£/ie Euclidean Jordan algebra (V$)r. 

Proof. If the Jordan algebra F is simple and Q = A, the determinant 
polynomial, by Proposition X.3.4 in [Faraut-Koranyi,1994], 



a m = / H(z)- m m (dz) = ±- f H(z)- m - 2 ^m(dz) 
Jv Jv 

= C f A(e + x)- m - 2 r m (dx). 
By Exercice 4 of Chapter VII in [Far aut-Koranyi, 1994] we obtain 

am r n (m + 2^)- 

In the general case 



1 r— i f n i 

a m = — T [ / Hi{zi)~ m ^^rriiidzi), 

Co Li J v* 

and the formula of the proposition follows. [j 
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4. Generalized Kantor— Koecher— Tits construction. From 
now on, Q is assumed to be of degree 4. The group of dilations of V : 
hf z = e~ l z (t G C) is a one parameter subgroup of L, and x(ht) = e -2 *. 
Put h t = exp(tif). Then ad (if) defines a grading of the Lie algebra t of 
K: 

£ = t-i + Bo + ti) 
with = {X G « | ad(if )X = j'X}, (j = -1, 0, 1). Notice that 

t_i = Lie(N) ~ V, t = -£'«e(L), Ad(o-) : tj -> 

and also that if belongs to the centre 3 (to) of to- The element if defines 
also a grading of p := W: 

p = p_ 2 + p_i + p + pi +P2, 

where 

pj = {p G p I aln{H)p = jp} 

is the set of polynomials in p, homogeneous of degree 7 + 2. The subspaces 
pj are invariant under K Q . Furthermore k(ct) : pj — > p_j, and 

p_ 2 =C, p 2 = CQ, p_i~V, pi~V. 

Let = t © p. Put E = Q, F = 1. 

Theorem 4.1. - There exists on g a unique Lie algebra structure 
such that: 

(i) [x,x'] = [x,x'] t (x.x'ei), 

(ii) [x,p] = d«(.x> (let^ep), 
(iii) [F, F] = if. 

Proof. Observe that (F, F, if) is an 5t 2 -triple, and that H defines a grading 
of 

= 0-2 + 0-1 +00 + 01 +02, 

with 

0-2=P-2, 0-l=t-l+P-l, 0O=to+Po, 01=tl+Pl, 02 = p2- 

It is possible to give a direct proof of Theorem 4.1 (see Theorem 3.1. in 
[Achab,2011]). It is also possible to see this statement as a special case of 
constructions of Lie algebras by Allison and Faulkner [1984]. We describe 
below this construction in our case. 
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a) Cayley- Dicks on process. 

Let denote the symmetry with respect to the one dimensional 

subspace Ce: 

x* = \ (x, e) — x. 

Observe that 

(x, e) = r(T x ) = D x logQ(e), (e, e) = 4. 

On the vector space W = V © V, one defines an algebra structure: if 
z 1 = {x 1 ,y 1 ),z 2 = {x 2 ,y 2 ), then z 1 z 2 = z = (x,y) with 

x = x x x 2 - \y\y 2 ) , V = x x y 2 + (yix 2 ) , 
and an involution 

z = ( x iv) = ( x , -y*)- 

This involution is an antiautomorphism: z x z 2 = z 2 Z\. For a, b G W, one 
introduces the endomorphisms V a ^ and T a given by 

V a ,bZ = {a, b, z} := (ab)z + (zb)a - (za)b, 
T a z = V a , e z = az + z(a - a). 

By Theorem 6.6 in [Allison- Faulkner, 1984] the algebra W is structurable. 
This means that, for a, b,c,de W, 

[V a ,b, Vc,d] = V V a , b c,d ~ V c y b ad . (*) 

Moreover the structurable algebra W is simple. By (*), the vector space 
spanned by the endomorphisms V a ^ (a, b G W) is a Lie algebra denoted 
by Instrl(W). This algebra is the Lie algebra Qq in the grading, and 
its subalgebra £o is the structure algebra of the Jordan algebra V. The 
space S of skew-Hermitian elements in W, S = {z G W \ z = —z}, has 
dimension one. Its elements are proportionnal to sq = (0, e). The subspace 
{(x,0) | x G V} of W is identified to V, and any element z = (x, y) G W 
can be written z = x + soy. 

b) Generalized Kantor-Koecher-Tits construction. 
One defines a bracket on the vector space 

K,{W) = S © W © InstrliW) © W © S, 

where S is a second copy of S, and W of W. This construction is described 
in [Allison, 1979], and, by Corollary 6 in that paper, KiW) is a simple Lie 
algebra. On the subspace JC(V) = V ©str(V) © V, this construction agrees 
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with the classical Kantor-Koecher-Tits construction, which produces the 
Lie algebra t = t-\ © to © t\. This algebra JC(W) satisfies property (i): 
the restriction of the bracket of K{W) to JC(V) coincides to the one of 
)C(V). It satisfies (iii) as well: [so, So] = I, the identity of End(W). 
It remains to check property (ii). This can be seen as a consequence 
of the theorem of the highest weight for irreducible finite dimensional 
representations of reductive Lie algebras. In fact, the representation dn 
of t on p is irreducible with highest weight vector Q, with respect to any 
Borel subalgebra b C to + t± : 

- If X e 61, then dn(X)Q = 0. 

-If X E t , such that d*y(X) = 0, then dn{X)Q = 0, and dn{H)Q = 2Q. 
On the other hand, for the bracket of JC(W), 

- If it G V, [u, s ] = 0. 

-If X E stt(V), such that tr(X) = 0, then [X, s ] = and [H, s ] = 2s . 
It follows that the adjoint representation of /C(V) = V ®stc(V) © V on 

S © s V © T w © s V © S, 

where Tw = {T w = V Wje \ w G W}, agrees with the representation dn 
of t on p. In the present case, T w = L(w) + \ (v, e)Id, if w = u + sov 

(u,v e V). 

On the vector space 

= 0_ 2 © 0-1 © 00 © 01 © 02, 

with 

Qi = W, 0-i =W, Q 2 = CE, 0_ 2 = CF, g = Instrl(W), 

one defines a bracket satisfying the following properties: 

(1) 0i +02 is a Heisenberg Lie algebra: 

01 X 01 -> 02, (Wi, W 2 ) ^ WlW 2 - W2WX = 1p(w 1 , W 2 )S . 

The bilinear form ij; is skew symmetric, and [^1,^2] = r ip{wi,W2)E. 

(2) 0i X 0_i ->■ 0o, (tU, w) 1— >■ K;,tD- 

(3) 02 x 0_i ->■ 01, (\E,w) i-)- Aw. Q 
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We introduce now a real form g K of g which will be considered in the 
sequel. In Section 2 we have considered the involution a of K given by 

a(g) = aogoa~ 1 (g e K), 

and the compact real form Kr of K: 

K R = {g e K | a{g) = g}. 

Recall that p has been defined as a space of polynomial functions on V. 
For pep, define 

p = p(z), 

and consider the antilinear involution /3 of p given by 

Observe that /3(E) = F. The involution /3 is related to the involution a 
of K by the relation 

K(a(g)) o = o K (g) (g e K). 
Hence, for g e K^, n(g) o f3 = ft o K,(g). Define 

Pr = {p e p | p{p) = p}. 

The real subspace p» is invariant under K-^, and irreducible for that 
action. The space p, as a real vector space, decomposes under K R into 
two irreducible subspaces 

p = p K © ip R . 

One checks that E + F e Pr (and hence i(E — F) as well). 

Let u be a compact real form of $j such that t fl u = ^r, the Lie algebra 
of Km.. Then p decomposes as 

p = p n (ill) © p H u 

into two irreducible i^R-invariant real subspaces. Looking at the subalge- 
bra 0° isomorphic to sl(2,C) generated by the triple {E,F,H), one sees 
that E + F epn (iu) . Therefore p M = p n (iu) , and 

0R = tlR ffi PR 

is a Lie algebra, real form of g, and the above decomposition is a Cartan 
decomposition of q-r. 

For the table of next page we have used the notation: 

iPn ( z ) = z f + ... + zl (zeC n ). 

In case of an exceptional Lie algebra g, the real form qr has been identified 
by computing the Cartan signature. 
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5. Representation of the generalized Kantor-Koecher-Tits Lie 
algebra. - Following the method of R. Brylinski and B. Kostant, we 
will construct a representation p of q = t + p on the space of finite sums 



m=0 

such that, for all X e t, p(X) = div(X). We define first a representation 
p of the subalgebra generated by E,F,H, isomorphic to sl(2, C). In 
particular 

p(H) = dn(H) = 4 Tr(exptif). 

at t=o 

Hence, for e (9 m (£), p(H)<j> = (S — 2m)0, where £ is the Euler operator 

One introduces two operators M. and P. The operator M is a multipli- 
cation operator: 

(M<j>)(w, z) = w(p(w, z), 
which maps m (H) into (9 m +i(S), and "D is a differential operator: 

(V<p)(w,z) = ^Q^<p ) j (w,z), 

which maps O m (E) into C m _i(S). (Recall that O-i(H) = {0}.) We 
denote by .M' 7 and X> CT the conjugate operators: 

Given a sequence (5 m ) m6 N one defines the diagonal operator 5 on 0(E) fi n 
by 

m m 

and put 

= M - 5 o D, 
/9(E) = ni^poiF^ia)- 1 = M a -So V a . 
(Observe that, since degQ = 4, then Q is even, and a = cr -1 .) 
Lemma 5.1. 

[p(H),p(E)] = 2p(E), 
[p(H),p(F)] = -2p(F). 
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Proof. Since 

p(H)M : ifj(z)w m i-» (£ - 2(m + l))^(^)«; m+1 , 
A4p(iO : i)(z)w m ^(S- 2m)i(j(z)w m+ \ 

one obtains [p(H),M] = —2M. Since 

: H- 5 m _i(£ - 2(m - 1))Q (— 

and, by using the identity 
one gets 

[p(#),M>] : V^)«> m H- 25 m _!g(— )i/'(z)«; m - 1 . 

Finally \p{H), p(F)] = —2p(F). Since the operator 5 commutes with ir(a), 
and 7r(a)p(if)7r(a)- 1 = -p(H), we get also [p(#),p(£)] = 2p(E). Q 

Let D(V) L denote the algebra of L-invariant differential operators on 
V. This algebra is commutative. If V is simple and Q = A, the 
determinant polynomial, then H)(V) L is isomorphic to the algebra V(C r ) er 
of symmetric polynomials in r variables. The map 

D !->■ 7(D), D(y) ->■ P(C r ) Sr , 

is the Harish-Chandra isomorphism (see Theorem XIV. 1.7 in [Faraut- 
Koranyi,1994]). In general V decomposes into simple ideals, 

i=l 

and 3(V) L is isomorphic to the algebra 

s 

i=l 
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The isomorphism is given by 



where 7* is the isomorphism relative to the algebra Vi. For D e D(F) L , we 
define the adjoint D* by D* = J0D0 J, where J/(z) = f°j(z) = f{-z~ l ). 
Then 7(£>*)(A) = 7(D)(-A). (See Proposition XIV.1.8 in [Faraut- 
Koranyi,1994].) 

In our setting we define the Maass operator D a as 

It is L-invariant. We write 

7 a(A)= 7 (^a)(A). 

If V is simple and Q = A, then 

7a(A) = n(A i -a+ 1(^-1)), 

( [Far aut-Koranyi, 1994], p. 296). If V is simple and Q = A fc , then 
D a = A fc + fca A^j fc A(^)- fca 

3=1 dz 

and 

7a(A) = f[ [A, -fca+§(£ -1)],. 

(We have used the Pochhammer symbol [a]jt = a (a — 1) . . . (a — k + 1).) 
Proposition 5.2. — In general 

7 a (A) = nfl[A? ) -M + i(^-l)] fci , 

i=ii=i 1 

/or A = (A* 1 ),. A« e C ri . 
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We say that the pair (V, Q) has property (T) if there is a constant rj 
such that, for X £ I = Lie(L), 

Tr(X) = t]t(X). 

In such a case, for g G L, 

Det(^) = 7(g)' 7 , 

and, for a; G V, 

Det(P(x)) = Q{x) 2r] . 

Furthermore Q(x)~ v m(dx) is an L-invariant measure on the symmetric 
cone Q C V R , and H (z) = H(z)~ 211 . 

Let V = @ s i=1 Vi be the decomposition of V into simple ideals. Property 
(T) is equivalent to the following: there is a constant r\ such that 

— = r]ki (i = l,...,s). 

In fact, for a; G V, 

s s 

Tr(T x ) = — tri(xi), t(T x ) = J^fcitrifo), 



i=i r * i=i 



with x = (xi, . . . , x s ), Xi G Vi. 

Property (T) is satisfied either if V is simple, or if V = C p © C p , and 

Q( z ) = ( z \ + ■ ■ ■ + z 2 p )(z 2 p+1 + ■■■ + z 2 p ). 

Hence we get the following cases with property (T): 

(1) V = C\ Q(z) = (z 2 + --- + 4) 2 , and then 

= 5 l(n + 2,C), £ = so(n + 2, C). 

(2) V = C p © C p , and then 

S =so(2p + 4,C), I = so(p + 2, C) ffiso(p + 2, C). 

(3) V is simple of rank 4, and Q = A, the determinant polynomial. 
Then 



= (e 6 ,sp(8,C)), (e 7 ,sl(8,C)), (e 8 ,so(16, C)). 
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Observe that the case V = C 2 , Q{z\, z^) = (ziz 2 ) 2 = z\z\ belongs both 
to (1) and (2). This corresponds to the isomorphisms: 

sl(4, C) ~ so(6, C), 50(4, C) ~ so(3, C) © so(3, C). 

Proposition 5.3. - The subspaces O m (E) are invariant under 
[p(E), p(F)], and the restriction of [p(E) , p(F)] to O m (E) commutes with 
the L-action: 

[p(E), p(F)} : O m (S) -> O m (E), ^{z)w m h- (P m V0(*)«> m , 

where P m is an L-invariant differential operator on V of degree < 4. it is 
given by 

P m = 5 m (D_! - D* m _i) + 5 m _i(D*_ m - D ). 

Proof. Restricted to O m (S), 

M ff D = D , D7W <J = D_ 1 , MP CT = Dl m , = D* m _i. 

It follows that the restriction of the operator [p(E), p(F)] to O m (S) is 
given by 

[p(£), /9(F)] = [AT - 5 o V a , M - 5 o V] 
= [M,SoV a ] + [5oV,M a ] 
= M5V a - 5V a M + 5VM a - M a 5 o V 
= 5 m (VM a - V a M) + b m _ x (MV° - M U V) 
= 5 m (D_! - DI m _ x ) + 5 m _i(D*_ m - D ). D 

By the Harish- Chandra isomorphism the operator P m corresponds to 
the polynomial p m = nf(P m ), 

Pm{\) = <y m (7_i(A) - 7_ m _i(-A)) + 5 m _i(7_ m (-A) - 70(A)). 

The question is now whether it is possible to choose the sequence (S m ) in 
such a way that [p{E),p{F)\ = p(H). Recall that restricted to C m (S), 

p(H) = £ - 2m, 

where £ is the Euler operator 

£<f>(w,z) = ^| t=o 0(w,ey). 
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Then, by Proposition 5.3, it amounts to checking that, for every m, 

p m {\) = 1 {£){\)-2m. 

Theorem 5.4. - It is possible to choose the sequence (S m ) such that 
[p(H), p(E)} = 2p(E), [p{H),p{F)\ = -2p(F), [p{E),p{F)\ = p(H), 
if and only if (V, Q) has property (T), and then 

A 



S m = 



(m + i])(m + 7] + 1) ' 



where A is a constant depending on (V, Q) . 

Proof, a) Let us assume first that the Jordan algebra V is simple of rank 



4. In such a case 



7a(A) = n(%-« + ^-l)) fa=£) 



3=1 



(Proposition 5.2) . With Xj = Xj + \ [r\ — 1), the polynomial p m can be 
written 



Pm(X) = 6m(f[(Xj + l)-f[(X j -m- v j) 

3 = 1 3=1 

4 4 

+ 6 m - 1 (j[(X j -m+l-T,)-l[X j ). 



3 = 1 3=1 

Furthermore 

4 4 

7(5)(A) - 2m = ^ A, - 2m = J^X,- - 2(m + ?? - 1). 

j=i i=i 

Lemma 5.5. - The identity in the four variables Xj 

4 4 4 4 

a(n(*i + !) - - & * - !)) + ^(n^ - ^ - n x ) 

3=1 3=1 3=1 3=1 

4 

3=1 
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holds if and only if there is a constant b such that 

b\ = b 2 = b 3 = 6 4 = b, c = -2b, 

1 



a = — — — — — — , (3 = 



(6 + l)(6 + 2)' 6(6+1)' 

Hence we apply the lemma, and get b = m + n — 1. fj 
b) In the general case 



7»w=nnK"-'^i(;-nL i 

i=i j=i 1 

=nnn(^ i) -^+i(^- i )-(*- 1 )) 

i=ij=ifc=i * 



i=l J=l fc=l 

with A = []i=i ^ ri - We introduce the notation 
Then we obtain 



p.(a) =^ m (n n n^i? + *) - n n - - *)) 

i=l J = l /c=l i=l .7 = 1 

S T*j k{ S T{ k{ 

+ (n n im? - ^> - n n no). 



i=l j=l fc=l i=l j = l k=l 

and 

i=l j = l k=l i=l j=l fc=l 



If the rank of V is equal to 4, then the ki are equal to 1, and the four 
xiables 
that case. 



(i) 

variables X-^ are independant. By Lemma 5.5, Theorem 5.4 is proven in 
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If the rank r of V is < 4, then 

x (i) _ x (i) k-1 

and there are only r independant variables: Xj\ . In that case Theorem 
5.4 is proven by using an alternative form of Lemma 5.5: [] 

Lemma 5.6. - To a partition k = (k±, . . . ,ki) of 4 and length £: 

fci + . . . + k t = 4, 

and the numbers 7^ (1 < i < I, 1 < j < k\ — 1 ), one associates the 
polynomial F in the t variables T\ , . . . , Ti : 

t ki-l 

F(T 1 ,...,T e ) = l[T i Y[(T i + lij ). 
t=i j=i 

Given a,f3,c<E R, and bi, . . .bi G R, then 

a(F{T x + 1, . . . ,T e + 1) - F(T\ - h - 1, . . . ,T e - b e - 1)) 

+ p ( F ( Tx - b ! , . . . , T e - b e ) - F ( T x , . . . , T e ) = T> + c 

i=i 

is an identity in the variables Ti, . . . , Tg if and only if there exists b such 
that 

6 i = - = 6 < = 6 . a= (b + i)(b + 2y 0= b(bTTy 

and 

t ki-l 
i=l j=\ 

For p G p, define the multiplication operator M.(p) given by 
(M(p)4>) (w, z) = wp(z)<j>(w, z). 
Observe that M(l) = M. Then, for g G K, 

M{K(g)p) = Tr(g)M(p)TT(g- 1 ). 

In fact 

(M(p)n(g~ 1 )(p) (w, z) = wp{z)(j){n{g, z)w, g ■ z), 
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and 



(n(g)M(p)n(g ^{w.z) 

= Kd' 1 , z)wp(g~ 1 ■ z)(p(fj,(g~ 1 ,z)fj,(g 1 g' 1 ■ z)w, g~ x g ■ z) 
= w(k{z)p) (z)(f)(w, z) = M (K(g)p)4>(w, z). 

Proposition 5.7. — There is a unique map 

p^End(O fin (S)), p^V(p), 
such that T>(1) = V, and, for g G K , 

V(K(g)p)=n(g)V(p)n(g- 1 ). 

Proof. Recall that, for g G -P ma x, 

(K(g)p)(z) = x(g)p(g~ 1 ■ z), 

and 

(n(g)(p)(w,z) = (f){x{g)w 1 g~ 1 ■ g). 
Let us show that, for g G -P max , 

Tr^xMs" 1 ) = x(g)v. 

Observe first that, for £ G L and a smooth function ip on V, 

Therefore, for g G P max , 

VTTig- 1 )^, z) = (V(xGT>, g-zj) 

= ^x(g) 2 (Q(^)(x(g- 1 )w,g-z), 

and 

{^V^g-^w.z) = -^ x {gY(Q(—)^( w , z ) = x (g)V4>(w,z). 

It follows that the vector subspace in End((9fi n (S)) generated by the 
endomorphisms Tv(g)Vir(g~ 1 ) (g G K) is a representation space for K 
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equivalent to p. (See Theorem 3.10 in [Brylinski-Kostant,1994].) Hence 
there exists a unique PJ-equivariant map p T>(p) such that T>(1) = V. 

D 

For pGp, define 

p(p) = M(p)-SV(p). 

Observe that this definition is consistent with the definition of p(E) and 
p{F). Recall that, for let, p{X) = dir(X). Hence we get a map 

/ 9: = l©p^End(C(S) fin ). 

Theorem 5.8. - Assume that Property (T) holds. Fix (S m ) as in 
Theorem 5.4- 

(i) p is a representation of the Lie algebra $j on 0(S)fl n . 

(ii) The representation p is irreducible. 

Proof, (i) Since tc is a representation of P, for X, X' e t, 

[p(X),p(X')]=p([X,X']). 
It follows from Proposition 5.7 that, for J G t,pG p, 

[p(X),p(p)] = p([X,p]). 
It remains to show that, for p,p' e p, 

[p(p)»p(p ; ]] = p([p»p']- 

By Theorem 5.4, [p(£?), p(F)] = p{H). Then this follows from Lemma 3.6 
in [Brylinski-Kostant,1995]: consider the map 

r : /\ 2 p -)■ End(G(S) fin , 

defined by 

r(pAp') = [p(p),p(p')] -p([p,p']). 
We know that r(£? A F) = 0. It follows that, for g £ K, 

r(K(g)EAK(g)F)=0. 

Since the representation k is irreducible, and F and F are highest and 
lowest vectors with respect to P, the vector E A P is cyclic in /\ 2 p for the 
action of K. Therefore r = 0. 
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(ii) Let V 7^ {0} be a p($j)-invariant subspace of (9(S)fi n . Then V 
is /9(t)-invariant. As C(S)fl n = ^m=o^n,(") anc ^ as ^ ne subspaces 
O m (S) are p(6)-irreducible, then there exists I C N (I ^ I) such that 
y = Sm6i^ >m (")- Observe that if V contains O m (S), then it contains 
C? m +i(H) too. In fact denote by 4> m the function in O m (S) defined by 
(f> m (w, z) = w m . As V(p m = 0, it follows that 

p(F)(j) m = M<fim = 0m+l, 

and p{F)cj) m belongs to m +i(S), therefore C m+ i(S) C V. Denote by mo 
the minimum of the m such that O m (E) C V, then 

oo 

V= O m (3). 

m=mo 

The function (j)(w,z) = Q(z) m w m belongs to O m (S), and 

p{F)<j>{w,z) = Q{z) m w m+1 -5 m - 1 Q(^Q{z) m w m - \ 
By the Bernstein identity (Proposition 3.1) 

Q(-£)Q{z) m = B(m)Q(z) m -\ 

and since B(m) > for m > 0, it follows that, if O m (E) C V with m > 0, 
then O m _i(H) C V. Therefore m = and V = 0(H) fin . Q 

6. The unitary representation of the Kantor-Koecher-Tits 
group. - - We consider, for a sequence (c m ) of positive numbers, an inner 
product on 0(H)fi n such that 

w 2 = E-ii^iil 

m=0 Cm 

for 

oo 

<j>(lV,z) = ^ ^m(z)w m . 
m=0 

This inner product is invariant under Km,. We assume that Property 
(T) holds, and we will determine the sequence (c m ) such that this inner 
product is invariant under the representation p restricted to 0r. We denote 
by H the Hilbert space completion of d?(S)fi n with respect to this inner 
product. We will assume cq = 1. 
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The Bernstein polynomial B is of degree 4, and vanishes at and 
a\ = 1 — T}. Let «2 and «3 be the two remaining roots: 

B(a) = Aa(a — a\){a — 0:2) (<* — 0L3). 

(1) V = C\ Q(z) = (zj + --- + z 2 n ) 2 . Then 

B{a) =Aa(a- ^) (a + (a + . 

A = 2 4 if n > 2, A = 4 4 if n = 1. 

(2) y = (z? + • • • + ^)(^+i + • • • + 4,)- Then 

B(a) = a 2 (a + ^— J . 

(3) V is simple of rank 4, complexification of Vr = ii/erm(4, F), 
(3(2) = A(z), the determinant polynomial. Then 

B(a) = a(a+^j{a + 2^j (a + 3^), 

where <i = dim^F. 

Here are the non zero roots of the Bernstein polynomial: 



V 


Oil 


«2 


«3 


n 


n— 4 


1 


n-2 


4 


4 


2 


4 


V 


p-2 





p-2 


2 


2 


2 


l + 3f 


^2 


d 

2 


9 ci 
Z 2 



Theorem 6.1. - (i) The inner product ofH is ^-invariant if 

= (?/ + l)m 1 

(»? + a2)m(?/ + a3)m m! ' 
(ii) TTie reproducing kernel ofH is given by 

/C(£, CO = 1*2(77 + 1; v + « 2 , ^7 + « 3 ; ^OW), 
/or £ = f = 
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Proof, (i) Recall that 

Pr = {p e p | /3(p) =p}, 

where /3 is the conjugation of p, we introduced at the end of Section 4. 
Recall also that 

0(<9)p) = n{a{g))p{p). 
The inner product of H. is g^-invariant if and only if, for every p G p, 

p{py = -p(my 

But this is equivalent to the single condition 

p{E)* = -p{F). 

In fact, assume that this condition is satisfied. Then, for p = n{g)E, 

(geK), 

Pip) = n(g)p(E)n(g- 1 ), p{p)* = -ttQT 1 )* p(F)n( g y . 

Since n{g)* = 7r(a(g)) , we get 

p(p)* = -n(a(g))p(F)n(a(g- 1 )) = -p(K(a(g))F) 

= -p(K(a(g))p(E)) = -p((3(K(g)E)) = -p(0(p)). 

Finally observe that the vector E is cyclic in p for the X-action. 

The condition p(E)* = —p(F) is equivalent to: for m > 0, e 
O m+1 (S),0'eC» m (S), 

— (0 | A<V)m+l = — I 0')m- 

Recall that mo(ck) = Ho(z)m(dz) with 

ffo(s) = ^W^, 
and the norm of O m (V) can be written 

M 2 m=^- I \m\ 2 H{z)- m - 2 ^m{dz). 
Then, the required condition of invariance becomes 

f iP(z)Q(zW(z)H(z)-( m+1) - 2v m(dz) 

Cm+l a m+l JV 

= — [ (Q{P)^)(zW(z)H(z)-™-^m(dz). 
c m a m J v \dzJ 
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By integrating by parts: 

d 



J v (Q(^)(z)ij'(z)H(z)- m -^m(dz) 



and, by the relation 



the condition can be written 



' - am+1 -5 rn B(-m-2 V ) — . 



From Proposition 3.2 it follows that 

Qm+l _ B{-m - 7]) 
a m B(-m-2rj)' 

We obtain finally 

Cm+l m + TJ+1 



c m (m + r] + a 2 )(m + r] + a s ) (m + 1) 
and, since cq = 1, 

= (V+I)m 1 

m (v + a 2 )m(v + a 3 )m mV 
(ii) By Theorem 2.5 the reproducing kernel of H is given by 



m=0 

= \F 2 (rj + a 2 ,r] + a 3 ; rj + 1; if (z, z')ww') , 

withe = K^,r = «^)- d 

We will see that the Hilbert space "H is a pseudo-weighted Bergman 
space. By this we mean that the norm is given by an integral of \(j)\ 2 with 
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respect to a weight taking both positive and negative values. The weight 
involves a Meijer G-function: 

2m J c _ loo F(a + s) 

where a, 0i, 02) 03 are real numbers, and c > a = — inf{0i, 02, /3s}- This 
function is denoted by 

G(u) = G^(x\^ ^ J 

(see for instance [Mathai,1993]). By the inversion formula for the Mellin 
transform 




Tjpi + S )T(I3 2 + s)T(I3 3 + s) 
T(a + s) 



for Res > a, and the integral is absolutely convergent. If the numbers 
0i, 02, 03 are distinct, then 

G(u) = (p^u)^ 1 + (p 2 (u)uh + (p 3 (u)u fi3 , 

where (pi,(p2,<P3 are holomorphic near 0. (<£>i> ¥>2> ¥>3 are \F 2 hypergeo- 
metric functions.) 

The function G may be not positive on ]0, 00 [, but is positive for u large 
enough. In fact 

G(u) ~ ^u e~ 2 ^ [u — >■ 00), 

where 

9 = fa + 2 + 3 - a - \ . 

([Paris- Wood, 1986], Theorem 3, p.32.) 
Now take 

a = rj - 1, 0i = 2rj - 1, & = 277 + a - 1, 03 = 2ry + 6 - 1. 





a 


01 


02 03 


(1) 


f-1 


n-2 
2 


n— 1 n— 2 
2 4 


(2) 


f-1 


p- 1 


p-1 § 


(3) 


3f 


3rf+ 1 


5§ + l 2d + l 
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The Mellin transform of G vanishes at —a, with changing sign. One 
can check that —a > a in all cases. Therefore there are real values s > a 
for which the integral 



/•OO 

/ G(u)u*- 1 du < 0. 
Jo 



This implies that the function G takes negative values on ]0, oo[. 
Theorem 6.2. — For G %, 

\4>{w, z)\ p(z, w)m(dw)mo(dz) , 

CxV 

with 

p(w,z) = CG(\w\ 2 H(z))H(z). 
The integral is absolutely convergent. 

Proof. We will follow the proof of Theorem 5.7 in [Brylinski,1997]. 
a) From the proof of Theorem 6.1 it follows that 

1 (2??) m (2?7 + a2)m(2?7 + a3)m 



O-mCm iji)m 

,r(2?7 + m)r(2?7 + a 2 + m)T(2i] + a 3 + m) 



C- 



T(r] + m) 



/•CO 

C / G{u)u m du. 
Jo 



(One checks that a < 1, i.e. G is integrable.) By the computation we did 
for the proof of Theorem 2.6, we obtain, for <fi{w, z) = w m ijj(z) G O m , 



/ \(f>(w, z)\ 2 p(z, w)m(dw)mo(dz) = 
Jcxv 



' CxV 

Furthermore, if e O m , <fi' G O m ', with m ^ m' , 



4>(w, z)4>' (w , z)m(dw)mo(dz) = 0. 

CxV 

It follows that, for 4> G Ofi n , 

2) \ 2 p(z, w)m(dw)mo(dz) = 
38 



The computation is justified by the fact that, for s > a, 

/•OO 

/ \G(u)\u 8 - 1 du < oo. 
Jo 

b) Let us consider the weighted Bergman space V, 1 whose norm is given 



\<j>(w, z)\ 2 \p(w : z)\m(dw)mo(dz) . 



|2 _ / |JY„., ~\|2| 

li 



By Theorem 2.6, 



with 



1 = ^ ~rT H^ m H"^ 



m=0 ° m 



1 — = cl \G{u)\u m du. 

i C m JO 



Obviously c m < c m , therefore V} C %. We will show that H C H 1 . For 
that we will prove that there is a constant A such that 

As observed above there is u > such that G(u) > 0, for u > u , and 
then 

/ \G(u)\u m < G(u)u m du + 2 \G(u)\u m du. 
Jo Jo Jo 

Hence 

"MO 



J_< J_ + 2a m < j U ° \G(u)\du. 

C m C ™ Jo 



By the formula we gave at the beginning of a), the sequence a m c m -u™ is 
bounded. Therefore there is a constant A such that 

1 „ 1 

— < A— , 

and this implies that H C H±. Q 
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Let Gr be the connected and simply connected Lie group with Lie 
algebra Qr and denote by K-r the subgroup of Gr with Lie algebra Br. It 
is a covering of Kr. We denote by s : Kr — >■ K^,g >->■ s(^) the canonical 
surjection. 

Theorem 6.3. (i) There is a unique unitary irreducible representa- 
tion tv of Gr on T-L such that dw = p. And, for all k G Kr, fc(k) = iv(s(k)). 
(ii) The representation tv is spherical. 

Proof, (i) Notice that if the operators p(E + F) and p(i(E — F)) are skew- 
symmetric, then for each p e Pr, the operator p(p) is skew-symmetric. In 
fact, since the s^-triple (F, F, H) is strictly normal (see [Sekiguchi,1987]), 
which means that H e Hr, E+F e Pr, i(E—F) e Pr, and since p = W(t)F, 
hence pR = W(^r)(£? + F) + W(tR)(i(£ | — F)), and the assertion follows. 

Now, by Nelson's criterion, it is enough to prove that the operator p(C) 
is essentially self-adjoint where £ is the Laplacian of Qr. Let's consider a 
basis {Xi, . . . , Xfc} of 6r and a basis {pi, . . . ,p{\ of pR, orthogonal with 
respect to the Killing form. As Qr = £r + pR is the Cartan decomposition 
of Qr, then the Laplacian and the Casimir operators of Qr are given by 

C = Xf + ... + X 2 k +p 2 1 + ...+pl 

c = xl + ... + xl-pl-...-pl 

It follows that C = 2(X 2 +. . .+X%)-C and p(C) = 2p(X 2 +. . .+X 2 )-p(C). 
Since p(Xf + . . . + X 2 ) = dir(X 2 + . . . + X%) and as 71 is a unitary 
representation of Kr, hence the image p(X 2 + . . . + X 2 ) of the Laplacian 
of 6r is essentially self-adjoint. Moreover, since the dimension of C(S)fl n 
is countable, then the commutant of p, which is a division algebra over 
C, has a countable dimension too, and is equal to C (see [Cartier,1979], 
p. 118). It follows that p(C) is scalar. We deduce that p(C) is essentially 
self-adjoint and that the irreducible representation p of jjr integrates to 
an irreducible unitary representation of Gr, on the Hilbert space H. 

(ii) The space Oq(E) reduces to the constant functions which are the 
K-fixed vectors. [j 

We don't know whether the representation if goes down to a represen- 
tation of a real Lie group Gr with Kr as a maximal compact subgroup. 
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